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ABSTRACT 

The test-retest reliability of the American Guidance 
Service (AGS) Early Screening Profiles (ESP) — a battery measuring 
development in the cognition/ language, motor, and self-help/social 
areas— was examined. The ESP is a nationally normed screening battery 
for children ages 2 years 0 months through 6 years i: months. In 
addition, parent and teac^ jr questionnaires were completed. The 
sample consisted of 116 children (60 females and 56 males) within the 
specified age range. Overall, 65% of the children were White, 31% 
were Black, 3% were Hispanic, and 1% was Southeast Asian. Each child 
was evaluated by examiners trained in administration of the battery. 
Retesting occurred an average of 3 weeks after initial testing, with 
a range of 2 days to 2 months. Pearson product moment correlations 
were computed; they produced the following test-retest coefficients 
for the immediate retest group: Cognitive/Language Profile, 0.90; 
Motor Profile*, 0.70; and Self-Help/Social Profile, 0.81. For the 
delayed rete^^c group, coefficients were: Cognitive /Language, 0.51; 
Motor Profile, 0.55; and Self-Help/Social Profile, 0.77. All 
correlations were statistically significant and fell in the moderate 
to strong range. The coefficients for the immediate group compare 
favorably with other instruments; the lower coefficients for the 
delayed group suggest that cognitive/ language and motor skills may be 
very fluid at this age. Two tables summarize the data. 
(Author/SLD) 
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Abetract 

Teet-retest reliability of the AGS Early Screening Profiles (ESP), 
a battery measuring developoent In the areas of oognlt ion/language, 
Botor and self -help/social is examined. The ESP is a natiatially 
normed screening battery for c±lldren ages 2 years, 0 months 
thjou^ 6 years, ;.l months with actual testing time ranging from 15 
to 30 minutes. In addition, parent and teacher questiormaizes axe 
completed in 10 to 15 minutes. The sample consisted of 116 
cMldren ages 2 years, 0 months throu^ 6 years, 11 months (60 
females and 56 males). Overall, 65% of the saaple was White, 31% 
was Black, 2X was Hispanic and 1% was Southeast Asian. Each cMld 
was evaluated with the ESP by examiners trained in the 
administration of the battery. Be-testing occurred on average 
three we^ after the initial testing with a range of two days to 
two months. Pearson product moment correlations were computed and 
produced these .est-retest coefficients for the ijnDedlate retest 
gvwpr Cognitive/Language Profile = .90, Motor ProfUe = .70 and 
Self-Help/Social Profile = .81; and for the delayed retest group: 
Cognitive/Language Pror^ile = .51, Motor Profile = .56 and 
Self-Help/Social Profile = .77. All correlations are statistically 
significant and fall in the moderate to strong range. 
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With the Ijncreasdd engphafils on preschool assessment, many new 
Instruments for the assessment of preschool children's abilities 
and skills have been developed. An example is the AGS Early 
Screening Profiles (ESP; Harrison, In press) , which is a nationally 
nonned screening battery for children ages 2 years, 0 months 
throuE^ 6 years. 11 months. Ihe battery meafiux«8 
cognitive/language, motor and self -help/social devcioiaent. In 
addition to direct measures of skills in these areas, 
questionnaires are ocmpleted by parents, teachers and screening 
examiners. The battery produces a Cognitive/Language Profile 
oonslBtix« of four subtests (Verbal Conoepts, Visual 
Discrimination. Logical Relations and Basic SdKX>l Skills), a Motor 
Profile oonslstlng of tno subtests (Giross Motor and Fine Motor) and 
a Self-Help/Social Profile consisting of four domains 
(Ccamunlcatlon. Daily Living Scale. Soclaliaation wid Motor) . 
Separate scores for Bxpresslve Language and Etooeptlve Language 
Areas are determined from performance on receptive and esqpressive 
items of Verbal Concepts and Basic School Skills subtests. 
Standard scores with a mean of 100 and standard deviation of 15 are 
provided for each measure. Actual testing time ranges from 15 to 
30 minutes. In addition, the parent and teacdter guestlonnpites are 
completed In 10 to 15 minutes. 

The Cognitive/Language subtests are ackninistored troa an 
easel-foxnat. Sample itesne are used to cooBunlcate the task. The 
Visual Discrimination subtest involves the dxild pointing to 
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pictures that match Btimalus picturee. In Verba? ConceptB the 
child points to pictures of objects named or described by the 
examiner, and names objects pictured or described by the examiner. 
The Logical Relatlcafis subtest requires the child to point to 
pictures that correspond to stlmlus pictures and to solve visual 
analogies. In Basic Schcol aillls the child answers questions 
about number and quantity concepta, and names and recognises 
numbers, letters and words. 

Items on the Gross Motor subtest assess the use of legs and 
arms for movement and coordination, while items on the Fine Motor 
subtest evaluate the use of hands and fingers for manipulating 
objects. 

The Coiounicatlon Domain of the Self-Help/Social Profile 
assesses the child's understanding and use of oral and written 
language in everyday Interactions. Ihe Dally Skills Domain 
measures the diild's ability In thi^ categories: personal (e.g. 
eating, dressing); domestic (e.g. cleaning, putting away toys); 
and community (e.g. safety, teleiAione, money). The SoclalizatlcMi 
Domain evaluates tiie child's skills in getting along with others, 
playing and coping with social demands. The Motor Dotaln measures 
the child's performance of everyday fine and gross mtor 
activities, e.g., walking. Jumping. Perfozmance in these domains 
is assessed through teacher/parent questionnaires. 

The standazxii2aticn sample for the ESP was based on 1990 
census estimates and stratified on the basis of sex, race or ethnic 
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grcop, coiMiunity size, region of tiie countr? and parents' level of 
education. The sample consisted of il49 :;.hlidrsn with 76 to 172 
diildren in each of 10 half-year gro«pe betvieen 2 years, 0 monthe 
and 6 years, 11 manths. 

Purpose of the Study 
An important element of reliability for a new test is its 
test-retefjt reliability. Therefore, the purroee of the prssent 
study was to Investigate the test-retest reliability of the ESP for 
two groups of children: an innediate retest group in Uhl<± the 
retesting occurred in 21 days or less and a delayed retest group iii 
vtddtx tne retesting occurred In 22 to 60 daye. 

Method 

The sample consisted of 116 children ages 2 years, 0 months 
throu^ 6 years, 11 monthe (60 females and 56 males). Overall, 65% 
of the sample was White, 31% was Blade, 3% was Hispanic and 1% was 
Southeast Asian. 

Each diild was evaluated with the ESP by examiners trained in 
the administration of the battery. Re-testlng occurred on average 
three weeks after the Initial testing with a range of two days to 
two months. Protocols were scored by American Guidance Servloe 
staff and double-checked for accuracy. 
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Results and DlBcusslon 
Mean scores for both grouops of diildren were iji the average 
range at both test and retest. Initial testing Indicated a range 
of mean profile scores from 96.2 on tlrie Cognitive Subscale Profile 
to 101.8 on the Self-Help/^ial Profile. On retesting mean 
profile scores ranged from 96.2 on the Cognitive Subscale Profile 
to 105.7 on the Self-lfelp/Sociai Profile. Gain scores ranged from 
-1.1 to 3.9 for the Ijniiediate retest grocqps and from 0.0 to 3.6 for 
the delayed retest growp. These results as well as test-retest 
reliability coefficients are presenxed in Table 1. 



iTiBert Table 1 about here 



Likewise, subtest scores were all in tlie average range for 
both groups at both test and retest. These scores ranged from 95.5 
to 101.8 for initial testing and from 96,2 to 104.1 for retesting. 
Gain scores i«nged from -1.0 to 2.4. These results as well as 
test-retest correlations are reported in Table 2. 



Insert Table 2 about here 



As expected test-retest reliability coefficients for the 
Ijmediate retest grcwp surpassed the coefficients for the delayed 
retest group. This pattern was present for both the profiles and 
individual subtests. Since the early childhood period is one In 
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Uhidti ^illB are rapidly developliig, teet-retest coefficients are 
likely to be lower with the passage of tine. After three weeks, 
the test-retest coefficients are nore likely to rsflect stability 
rather than reliability. 

Using r = .80 as an acceptahle criterion for test-retest 
reliability for screening measures, the Cognitive/Language Profile 
and Self -Help/Social Profile, Cognitive Subsoale and Language 
Subscale demonstrate acceptable test-retest reliability as shown by 
the Imnediat* retest group. The some»Aiat lower reliability 
coefficient for the Motor Profile (r = ,70) reflects the lower 
reliability often shown by gross motor scales, especially at 
younger ages. 

These test-retest coefficients for the iinmediate retest groiip 
coopare favo^^bly with other instruments. For expijjple, two-week 
test-retest reliability coefficients for the Developmental 
Indicators for the Assessment of Leamlng-Bevlsed (DIAL-R) using a 
aangple of 65 diildren were as follows: Motor = .76; Concepts = 
.90; Language = .77 and Total Test = .87 (Linder, 1985), 
Similarly, test-retest reliability coefficients on the Battelie 
Developmental Inventory (BDI) for 183 diildren over a four week 
interval ranged from .71 to .99 with most coefficients above .80 
(Oehler-Stlnrott, 1989). 

The Bomertiat lower test-retest coefficients for the delayed 
retest group suggest that skills in the cognitive/language area and 
motor area may be verjr fluid at this age. Additionally, the 
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smaller sanple size (40 versus 74) may have affected the results. 
Additional stability studies are needed to investigate this issue. 

For both groups, Basic School Skills and Verbal Concept 
subtests produced the hl^est test-retest coefficients with the 
Logical Relations subtest producing the lowest (r = .69 and r = .66 
for the -^jamediate and delayed retest groups, respectively) . Area 
scores for Expressive Languagf^ and Beneptive Language were nearly 
identical for both groups (r = ,86 to .87). 

Althcuah test-rfetest coefficients for Individual subtests are 
not significantly different for the iniDediate and delayed retest 
groups, the coefficients are consistently lower for the delayed 
retest group. The largest differences in test-retest coefficients 
between the two groups are present for the Visual Discrimination 
(.82 versus .67) and Basic School Skills («91 versus .78) subtests. 
Thus, the skills measured by these subtests may well be more fluid 
than the skills ineasured by other subtests. At the same time, the 
test-retest coefficients for the delayed retest groups may be 
affected to a greater degree by acquisition of skills and concepts 
than the coefficients obtained the Imnediate retest condition. 

Overall, test-retest reliability coefficients for 
language-related areas were hi^ier than non-language areas for both 
groups. This result is consistent with previous research 
Indicating verbal skills are more stable than nonverbal skills and 
less susceptible to practice effects. Overall gain scores in all 
areas and on all subtests were typically three points or less. 
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In cxanclueion, the ESP, a newly develcfped screening battery 
for children ages 2 years, 0 months through 6 years, 11 months, 
demonstrates adequate test-retest reliability. For the lamediate 
retest growiP, reliability coefficients for profile areas ranged 
froB .70 (Motor Profile) to .93 (Language Subecale) with a mean 
coefficient of .83. Total Screening Profiles produced reliability 
coefficients rangljng from .78 (Motor + Self -Help/Social) to .89 
(Cognitive/Language + Self -Help/Social) . Subtest reliability 
coefficients ranged from .69 (Logical Relations) to .91 (Basic 
School Skills) . A similar pattern existed with the delayed retest 
grcwp with the magnitude of correlations somewhat lower. 
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Table 1 

Profile reliability data for inmediato reteet and delayed reteet groups 

Standard Scores 
N Test Reteet Gain 







Mean 


SD 


Mean 


SD 


Score 


r 


lonediate Retest Group 
















Profiles 
















Cognitive/Language 


74 


98.8 


13.5 


101.0 


14.9 


2.2 


.88(.90) 


Motor Profile 


71 


100.8 


14.2 


99.7 


13.2 


-1.1 


.66(.70) 


Self-Help/Social 


27 


101.8 


14.9 


105.7 


15.8 


3.9 


.81(.81) 


Cognitive Subecale 


74 


97.7 


13.5 


99.4 


15.1 


1.7 


.78(.82) 


Laonguage Subecale 


74 


100.1 


13.2 


102.2 


13.3 


2.1 


.91(.93) 



Total Screening 
Cognitive/Language + 
Motor + Self -Help/ 

Social 27 99.3 13.7 101.8 15.2 2.5 .84(.87) 
Cognitive/Language -»■ 

Motor 47 96.1 13.0 96.4 13.5 0.3 . 82(.86) 
Cognitive/Language -«■ 

Self-Help/Social 27 99.6 13.7 103.3 15.9 3.7 .87(.89) 
Motor + Self -Help/ 

Socia 27 101.0 15.4 103.6 16.6 2.6 .79(.78) 
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Delayed Reteet Group 
Profiles 



Cognitive Aianguage 


40 


96.3 


11.7 


97.0 


14.4 


0.7 


.50( .51) 


Motor Profile 


42 


100.1 


14.2 


103.7 


13.8 


3.6 


.50(.55) 


Self-Help/Social 


34 


99.5 


12.5 


100.4 


14.0 


0.6 


.65(.77) 


Cosnitive Subecale 


40 


96.2 


14.2 


96 • 2 


15.9 


0.0 


.70( .73) 


Language SubBcale 


41 


98.1 


13.1 


98.9 


11.4 


0.8 


.88(.91) 


Dtal Screening 
















Co£iitlve/Language 4 
















notor + Seli-nelp/ 
















Social 


32 


100.0 


14.0 


101.0 


14.3 


1.0 


.61(.53) 


Cognitive/Language 
















Motor 


40 


98.3 


13.8 


100.0 


13.4 


1.7 


.75(.81) 


Cosnltlve/Language 
















Se<lf -Help/Social 


32 


95.1 


13.9 


99.2 


14.4 


1.1 


.79(.82) 


Motor + Self-Help/ 
















Social 


34 


100.3 


14.1 


103.3 


14.4 


3.0 


.69(.73) 



Hote . Gain socre = mean standard Boore from second testing minus mean from 
first testing. 

r = Fear&cm correlation betneen standard scores. Value in parentheses is the 
Pearson correlation corrected for restriction of the standard score range 
obtained ty the test-retest sample. 
All correlatiais are significant (p < .05). 
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Table 2 

Subtest reliability data for iiwnediate retest and delayed retest groups 



Standard Scores 
N Test Retest Gain 

Mean SD Mean SD Score 

Lmediate Betest Group 
Subtests 



Verbal Concepts 


74 


101.8 


13.5 


104.1 


13.5 


2.3 


.83(.86) 


Visual DlBcrlminatl<»i 


74 


97.2 


12.7 


99.3 


13.4 


2.1 


.76(.82) 


liOglcal Relations 


74 


98.4 


14.0 


99.2 


16.1 


0.8 


.64(.69) 


Basic Sdiool Skills 


74 


99.1 


12.4 


100.3 


13.0 


1.2 


.87(.91) 


ceas 
















Eicpresslve Language 


74 


101.1 


13.3 


102.7 


12.2 


1.6 


.82(.86) 


Receptive Language 


74 


99.7 


12.5 


101.0 


12.5 


1.3 


.81(.87) 



Delayed Retest Group 

Subtests 
Verbal Ck^^^cepts 
Visual D.v<crlJDlnation 
Logical Belaticns 
Basic School Skills 

Areas 
Expressive Ltuigaage 
Receptive Language 



42 


98.2 


13.5 


100.6 




97.4 


13.4 


97.2 


40 


95.5 


15.2 


96.? 


41 


98.2 


12.2 


97.2 


41 


99.5 


12.9 


100.9 


41 


98.1 


12.1 


99.3 



12.0 


2.4 


.83(.86) 


15.3 


-0.2 


.59(.67) 


16.3 


0.7 


.67(.66) 


11.3 


-1.0 


.67(.78) 


12.0 


1.4 


.83(.87) 


11.7 


1.2 


.80(.87) 
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tio^. Gain soore = wean Btancard soore from eeoond testing minus mean from 
first testijng. 

r = Pearson cx^rrelatlon beti^eeti standard scores. Value in parentheses is the 
Pearson correlation corrected for restriction of the standazxl score range 
obtained by the teet-retest sample. 
All correlations are significant (p < .05). 
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